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Method and Apparatus for Detecting the Location and 
Luminance Transition Range of Slant Image Edges 

By 
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Field of the Invention 

The present invention relates to image detail 
enhancement, and in particular, to detecting the location as 
well as the luminance transition range of slant image edges 
in digital images. 

Background of the Invention 

In digital image systems (such as digital TV systems) , 
in order to boost video quality, images are often enhanced 
in many different aspects, such as image details, image 
contrast, etc., before being displayed. For a digital 
image, the quality of edges in the image (i.e., image edges) 
is of great importance to the overall image quality. 
Therefore, during the enhancement processes, each image edge 
should be well preserved. In other words, image enhancement 
should not sacrifice image edge quality. Otherwise, the 
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overall visual quality of the image may be degraded even 
though the image is enhanced in certain aspects. 

An instance of such visual quality degradation is a 
5 zigzagged edge artifact due to conventional image detail 

enhancement. As the goal of image detail enhancement is to 
improve the image sharpness, high frequency image components 
that contain image details are extracted, enhanced and then 
added back to the original image. As a result, image 
10 details in the processed image become more obvious than 
those in the original image. However, some artifacts can 
also be introduced into image edges because of the 
enhancement . 

15 An example of the zigzagged edge artifact is described 

in conjunction with FIGS. 1A-B. FIG. 1A shows an original 
image edge 10, wherein each small rectangular/square block 
11 in the edge 10 represents one image pixel. The edge 
direction has a low angle relative to the horizontal 

20 direction. Along the horizontal direction across the edge, 
there is a long luminance transition range 12 from dark area 
to bright area or vice versa, as indicated in FIG. 1A. The 
luminance transition range 12 refers to the length of the 
luminance transitioning area of an edge either along the 
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horizontal direction or along the vertical direction across 
the edge. The boundary of the edge shown in FIG. 1A looks 
generally smooth even though the edge has a limited image 
resolution. 

5 

A conventional image detail enhancement process is 
applied to the image edge 10 of FIG. 1A to generate the 
enhanced image 14 in FIG. IB. Because in an image detail 
enhancement process high frequency components are boosted, 

10 the luminance transition range 12 may become shorter (or 
sharper) . As can be seen in FIG. IB, the luminance 
transition range 12 along the horizontal direction has 
become much shorter relative to that in FIG. 1A. As a 
consequence, the edge boundary now includes zigzagged edge 

15 artifacts. The more the image is enhanced in the detail 

enhancement process, the more obvious this kind of artifact 
would be. As a result, even though the image in FIG. IB is 
enhanced, the quality of the image looks poor due to the 
degradation of edge quality. 

20 

The problem shown in FIG. IB exists for most slant image 
edges. A slant image edge refers to an image edge whose 
direction is not exactly vertical or horizontal. Only when 
an image edge has exactly vertical or horizontal or 
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precisely ±45° (i.e. +45° or -45°) direction, it is immune to 
the problem shown in FIG. IB. Otherwise, a slant image edge 
can develop zigzagged artifacts if it is enhanced 
substantially. The closer its direction is to horizontal or 
5 vertical direction, the easier it is for a slant image edge 
to develop zigzagged edge artifact when enhanced 
substantially and the more obvious the artifact would be. 

Therefore, there is a need for a method of detecting the 
10 location and the luminance transition range of slant image 
edges so that pixels belonging to a slant edge can be 
processed separately or differently from the other image 
areas to avoid possible edge artifact. 

15 Brief Summary of the Invention 

The present invention addresses the above needs. In 
one embodiment, the present invention provides a method that 
can be used for detecting the location and luminance 
transition range of slant image edges in a digital image so 
20 that pixels belonging to each slant edge can be processed 
separately. In one example, the detection method is 
conducted on a pixel basis, wherein each pixel is checked 
together with its neighboring pixels inside a rectangular 
window centered with the current pixel . 
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Such a detection method includes four main processes, 
identified as an Edge Region Detector, a Binary Pattern Data 
Generator, a Slant Edge Center Locator and a Luminance 
5 Transition Range Detector. In the Edge Region Detector, the 
variance value for the pixels inside said rectangular window 
is calculated. Based on the variance value, a current pixel 
can be classified as being in an edge region or in a non- 
edge region. If the current pixel is in a non-edge region, 
10 no further checking is needed. However, if the current 

pixel is in an edge region, then in the Binary Pattern Data 
Generator, binary pattern data is generated from the pixels 
inside the rectangular window. 

15 Using binary data instead of the original image data 

greatly reduces the complexity of the detection process. 
Binary Pattern Data are generated based on the luminance 
value of each pixel inside the rectangular window and the 
mean luminance value of all the pixels inside the window. 

20 

In the Slant Edge Center Locator, it is determined 
whether the current pixel is a center pixel in a luminance 
transition range of a slant edge. This determination is 
based on the binary pattern data at the current pixel 
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location and its e.g. eight immediate neighboring binary 
pattern data. Initially, a pattern matching process is 
performed to determine if the' current pixel is the center 
pixel in a luminance transition range of a e.g. 

5 approximately ±45° direction edge. If it is, then no 

further processing is needed at the current pixel location 
and the luminance transition range is considered as 3 pixels 
wide . 

10 Otherwise, if no pattern is matched, then still based on 

the nine binary pattern data (i.e., the binary data of the 
current pixel and the 8 neighboring pixels) , another 
checking process is performed to determine whether the 
current pixel is a center pixel in a luminance transition 

15 range other than an approximately ±45° slant edge. If the 
current pixel is considered as a center pixel in a luminance 

transition range other than an approximately ±45° slant 
edge, then the Luminance Transition Range Detector is used 
to detect the exact length of the luminance transition range 
20 of the slant edge by checking more binary pattern data 
inside the rectangular window. 

Through such detection processes, both the center 
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position and the luminance transition range of slant image 
edge can be determined. These and other features, aspects 
and advantages of the present invention will become 
understood with reference to the following description, 
5 appended claims and accompanying drawings. 

Brief Description of the Drawings 

FIG. 1A shows an example smooth- looking image edge 
before detail enhancement ; 
10 FIG. IB shows the same edge in FIG. 1A after detail 

enhancement, wherein the edge becomes zigzagged due to 
enhancement ; 

FIG. 2 shows an example block diagram of an embodiment 
of a detection system for detecting the center position and 
15 the luminance transition range of slant image edge, 
according to the present invention; 

FIG. 3 shows a diagram of pixels inside an example 
window centered with a current/select pixel and its 
neighboring pixels, for the detection of slant image edge 
20 at the current pixel location; 

FIG. 4 shows an example flowchart of steps for 
processing in an embodiment of the Edge Region Detector of 
FIG. 2; 
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FIG. 5A shows an example of image pixel data inside 
the window centered with a current pixel; 

FIG. 5B shows an example corresponding binary data 
pattern generated from the pixel data shown in FIG. 5A; 

FIG. 6 shows eight example patterns that can be used 

to detect ±45° slant image edge; 

FIG. 7 shows an example flowchart of the steps for 
processing in an embodiment of the Binary Pattern 
Generator and the Slant Edge Center Locator of FIG. 2; and 

FIG. 8 shows an example flowchart of the steps for 
processing in an embodiment of the Luminance Transition 
Range Detector of FIG. 2. 

Detailed Description of the Invention 

The present invention addresses the above needs. In one 
embodiment, the present invention provides a method for 
detecting the location and luminance transition range of 
slant image edges in a digital image, so that pixels 
belonging to each slant edge can be processed 
separately/differently than other image pixels. 

As noted, in one implementation, the detection method is 
conducted on a pixel basis, wherein each pixel is checked 
together with its neighboring pixels inside a rectangular 
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window centered with the current pixel . The variance value 
of the pixels inside the rectangular window centered with a 
current pixel is checked to determine if the current pixel 
is in an edge region or in a non-edge region. If the 
5 current pixel is in an edge region, then binary pattern data 
is generated from the pixels inside the rectangular window 
based on their mean value. Then using the binary pattern 
data, a pattern matching process is performed to determine 
whether the current pixel is a center pixel in a luminance 

10 transition range of an approximately ±45° direction edge. 
If the current pixel is not a center pixel in a luminance 

transition range of an approximately ±45° direction edge, 
then using the binary pattern data, another pattern matching 
process is performed to determine whether the current pixel 
15 is a center pixel in a luminance transition range other than 

an approximately ±45° direction edge. If the current pixel 
is determined to be a center pixel in a luminance transition 

range other than an approximately ±45° direction edge, then 
the exact luminance transition range is detected based on 
20 the binary pattern data, as described below in more detail. 



Referring to the example block diagram in FIG. 2, a 
detection system 100 implementing the above method of the 
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present invention includes four processing blocks, 
identified in FIG. 2 as an Edge Region Detector 110, a 
Binary Pattern Data Generator 12 0, a Slant Edge Center 
Locator 130 and a Luminance Transition Range Detector 140. 
In the Edge Region Detector 110, the variance value for the 
pixels inside said rectangular window is calculated. Based 
on the variance value, a current pixel can be classified as 
being in an edge region or in a non-edge region. If the 
current pixel is in a non-edge region, no further checking 
is needed and a next pixel is processed. However, if the 
current pixel is in an edge region, then in the Binary 
Pattern Data Generator 120, binary pattern data is generated 
from the pixels inside the rectangular window. 

Using the binary data instead of the original image data 
is to reduce the complexity of the detection process. In 
the example Slant Edge Center Locator 13 0 herein, using the 
binary pattern data it is determined whether the current 
pixel is a center pixel in a luminance transition range of a 
slant edge. In one example, the binary pattern data at the 
current pixel location and its neighboring pixels' binary 
pattern data (e.g., eight immediate neighboring pixels' 
binary pattern data) , is used in a pattern matching process 
to determine if the current pixel is the center pixel in a 
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luminance transition range of a e.g. approximately ±45° 
slant edge. If it is, then no further processing is needed 
at the current pixel location and the luminance transition 
range is considered as three pixels wide. 

5 

Otherwise, if no pattern is matched, then still based on 
the nine binary pattern data (i.e., the binary data of the 
current pixel and the 8 neighboring pixels) , another pattern 
matching process is performed to determine whether the 
10 current pixel is a center pixel in a luminance transition 

range other than an approximately ±45° slant edge. If the 
current pixel is considered as a center pixel in a luminance 

transition range other than an approximately ±45° slant 
edge, then the Luminance Transition Range Detector 14 0 
15 detects the length of the luminance transition range of the 
slant edge by checking more binary pattern data inside the 
rectangular window. 

Through such a detection process as shown in FIG. 2 and 
20 described, both the center position and the luminance 

transition range of slant image edge can be determined. In 
the following, the functionality of each of the four 
processing blocks/modules in FIG. 2 is explained in more 
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detail. At the outset, it is worth noting that preferably 
the processing according to FIG. 2 is performed twice at 
every pixel location, one for checking image edges whose 
direction is close to the horizontal direction and another 
5 for checking image edges whose direction is close to the 

vertical direction. The following, description is based on 
the case wherein the edge direction is close to the 
horizontal direction. However, similar steps are applicable 
to image edges whose direction is close to the vertical 
10 direction, by exchanging the processing of the rows and 
columns in the rectangular window. 

FIG. 3 shows an example diagram of a rectangular 
window 300 including pixels 310 (i.e., p) , wherein the 

15 window 300 is defined inside the original image. In this 
example, the window 3 00 is centered with a current/selected 
pixel 320. Only the pixels inside the rectangular window 
3 00 are used for the detection of a slant image edge at the 
current pixel location. The rectangular window 300 has a 

20 dimension of W pixels along the horizontal direction and H 
pixels along the vertical direction, such thatZ is the 
total number of pixels 310 inside the rectangular window 
300 (i.e., L = W*H). In this example, both Hand Ware odd 
numbers. Indices / and j are integer and represent the 
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row and column index for the corresponding pixel , wherein 
p i} denotes each pixel 310 inside the window 3 00, and each 

value b i} denotes the corresponding binary pattern data. 

5 As shown in FIG. 3, the detection is based on 

neighboring pixels within the rectangular window centered 
with the current pixel 32 0, designated as p 0 ,o - The current 
pixel p 0/ o is represented as a circle with a cross therein. 
The hollow circles represent neighboring pixels/samples of 
10 the current pixel p 0/0 . Though eight immediate neighboring 
pixels are used in this example, as those skilled in the 
art will recognize, other number of neighboring pixels and 
at different positions relative to the current pixel p Qf0 
may also be used. 

15 

To detect a slant edge in the window 3 00 whose 
direction is close to the horizontal direction, H takes a 
value of 3 and W takes a value larger than 3 . As noted 
above, symmetrically, to detect a slant edge whose 
20 direction is close to the vertical direction, W takes a 
value of 3 and H takes a value larger than 3 . 
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FIG. 4 shows example steps for determining if the 
current pixel is located in an edge region or not. 
Referring to the example steps in FIG. 4 in conjunction 
with the diagram of FIG. 3, at the starting step 400, the 
5 window 300 of pixels 310 is selected (step 402) . In this 
example H= 3, indicating that 3 rows of image pixels are 
utilized , and W has a larger value than 3 because it 
determines the maximum length of the luminance transition 
range that can be checked along horizontal direction. As 
10 such, in FIG. 3, W = 11. The selected values for W and H 
are examples only, and other values can also be selected as 
those skilled in the art will appreciate. 

As described, each pixel inside the window 300 is 
15 denoted as p i} . After selection of the window 300, the Edge 

Region Detector 110 in the detection system of FIG. 2, 
first checks whether the current pixel p 0/ o is in an edge 
region. To do so, a variance value <j is calculated based 
on a plurality of pixels around the current pixel p 0 ,o in 
20 the rectangular window (step 404) . The following is an 
example relation for calculating the variance value a , 
wherein: 
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tv-\ 

L /=-l,0,l^ w-\ 

wherein, I i} denotes the luminance value of pixel p i} , m 

is the mean value of said plurality of pixels inside the 
rectangular window 3 00, and is defined according to the 
5 following example relation: 

w-\ 

^ f— 1,0,1 ._ w-\ 
J ~ 2 

The variance value a is then checked against a 
predetermined threshold T, wherein T > 0 (step 408) . If a 
10 is smaller than T, then the current pixel p Q0 is considered 
to be in a non-edge region. In that case, no further 
checking is needed at the current pixel p 00 location and the 
process moves to the next pixel (step 410) . 

15 However, if the variance value a is not less than the 

threshold T, the current pixel p 0t0 is considered as being 
in an edge region and the Binary Pattern Data Generator 12 0 
is used to generate binary pattern data from the pixels in 
the window 300, as shown by the example diagrams in FIGS. 

20 5A-B. In the description herein, the windows in FIGS. 3 and 
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5A-5B, are of the same dimensions and the values therein are 
indexed in rows and columns in the same manner as described 
in relation to FIG. 3. Now also referring to the example 
steps in FIG. 7, in order to generate the binary pattern 
5 data from the L pixels inside the rectangular window 3 00, 
in the Binary Pattern Data Generator 12 0 the luminance value 
I t j of each pixel is compared with the mean value m (step 

700) , whereby the corresponding binary data can be generated 
according to the example relation: 

f 0 if/;</M 
I 1 « *ij - m 

FIG. 5A shows example image pixel data in said window 
300 of FIG. 3, centered around the current pixel p 0t0 , as 
indicated. In the example shown in FIG. 5A, pixel 
15 luminance is in a range of [ 0, 255 ] . A value of 7.^=255 
represents the brightest luminance level and a value of 
Iij-0 represents the darkest luminance level. Using the 

above relations, the mean value m is calculated to be 123 
for the pixel values in FIG. 5A, wherein the diagram in 
20 FIG. 5B shows a pattern 500 of binary data 510 generated 
from the pixel data shown in FIG. 5A according to relation 
(3) . 
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Then, in the Slant Edge Center Locator 13 0 of FIG. 2, 
the binary data values in the pattern 500 at the location 
of pixel p 0t o and its eight immediate neighboring binary 
5 data values are checked to determine whether the current 
pixel p 0 ,o is the center pixel in a luminance transition 
range of a slant image edge (step 702) . As noted, the 
binary value corresponding to the location of the current 
pixel p 0/ o is b 00 , and the binary values corresponding to 
10 the eight neighboring pixels of the current pixel p Qf0 , are 
b± t j , i, j = -1, 0, 1, excluding b 00 itself. Based on said 

binary pattern data b± t j , wherein i, j = -1, 0, 1, a 
pattern matching process is performed to determine whether 
the binary data matches one of the example patterns 600 for 

15 approximately ±45° direction edge shown by example in FIG. 
6. Altogether, there are eight patterns 600 in FIG. 6, 
identified as (a) through (h) . If the nine binary pattern 
data b gJ = —1,0,1 in FIG. 5B (shown in a dashed box 520 in 

FIG. 5B and corresponding to the pixels 32 0 in FIG. 5A) 
20 matches one of the patterns shown in FIG. 6, then the 
current pixel p 0 ,o is considered as a center pixel in a 
luminance transition range of an approximately ±45° 
direction edge (step 704) . In addition, the luminance 
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transition range is considered as 3 pixels wide. In that 
case, no further checking is needed at the current pixel 
location and the process moves to the next pixel position 
(step 706) . 

5 

If the nine binary pattern data 520 in FIG. 5B does 
not match any of the patterns 600 shown in FIG. 6, then the 
checking process continues to determine whether the current 
pixel p 0/0 is the center pixel in a luminance transition 
10 range other than an approximately ±45° slant edge. As such, 
the closest four neighboring binary pattern data, b_ x o , b l0 , 

6 0 _j and b 0] , are checked first (step 708) . If b_ XQ and b XQ 

have different values, and b 0 _ x and b Ql also have different 

values, then the current pixel p 0/ o is considered as a 
15 candidate for being the center pixel in a luminance 

transition range of a slant edge. These conditions can be 
expressed according to the example relation: 

20 If condition (4) is not satisfied (i.e., it is false), 

then the current pixel p 0 ,o is not a center pixel in the 
luminance transition range of a slant image edge, and no 
further checking is needed at the current pixel location, 
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so that the process moves to the next position (step 706) . 
Otherwise, if condition (4) is satisfied (i.e., true), then 
the other four binary pattern data, , b_ ] X , b x _ x and b llt 

are checked (step 710) . If and b_ xx both have the same 

value as b_ l0 , and also b x _ x and b hl both have the same value 

as b l0 , then the current pixel p 0 ,o is considered as a 

center pixel in a luminance transition range of a slant 
edge. In addition, it can be assumed that the luminance 
transition range centered with the current pixel is at 
least 3 pixels wide. These above conditions can be 
expressed according to the example relation: 

y=-i,i 

If condition (5) is not satisfied (i.e., it is false), 
then the current pixel p 0 ,o is not a center pixel in the 
luminance transition range of a slant image edge, and no 
further checking is needed at the current pixel location, 
so that the process moves to the next position (step 706) . 

Otherwise, if condition (5) is satisfied (i.e., true), 
then as shown by the example steps in FIG. 8, the Luminance 
Transition Range Detector 14 0 in FIG. 2 detects the length 
of the luminance transition range with more binary pattern 
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data involved in the checking process. In the Luminance 
Transition Range Detector 140, the detection of the 
luminance transition range starts from columns 2 and -2 
around the current pixel p 0 ,o in the binary pattern 500 such 
as in FIG. 5B, and goes left and right simultaneously (step 
800) . Each time two more columns of the binary pattern 
data are included, one from the left side and one from the 
right side of the current pixel. 

For example, initially the binary values b_ x _ 2 , b 0 _ 2 and 
b x _ 2 from column -2, and the binary values b_ X2 , b 02 and b X2 
from column 2 are included in the process. If b_ x _ 2 , b Q _ 2 and 
b x _ 2 each has the same value as b_ x , Z> 0 _, and b x _ x , 
respectively, and b_ l2 , b oa and b x2 each has the same values 

K,\ and K\ ' respectively, then the pixel corresponding 

to b 0 _ 2 and the pixel corresponding to b 02 can also be 

considered as being in the luminance transition range of 
the edge, so that is can be assumed that the luminance 
transition range is at least 5 pixels wide. 

Using the same method, column -3 and column 3 of the 
binary pattern data can also be checked. If data in column 
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-3 are the same as those in column -2, and meanwhile data in 
column 3 are the same as those in column 2, then it can be 
assumed that the luminance transition range is at least 7 
pixels wide. 

5 

As such, in general, after column k-l and column -(k-\) 
are checked, wherein the luminance transition range is 
assumed to be at least 2*(£-l) + l pixels wide, then column k 

W -\ 

and column -k can be checked, where 2<k< . For 

2 

10 example, to check the binary pattern data in column k and 
column -k (step 802) , the following example condition 
according to the above description, is utilized: 

Ed fc a-V.I + IV*-V* + .l) = 0 (6) 

i= -1,0,1 



15 If condition (6) is satisfied (i.e., true), then column 

k and column -k have the same data as that in column k-\ 
and column respectively, and it can be assumed that 

the luminance transition range is at least 2*&+l pixels 
wide. Then, so long as there is another column to consider 

20 (step 804) , the process is extended to the additional 
columns as noted above (step 806) . 
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Therefore, such a checking process can continue until 
either condition (6) is not true, wherein the process 
proceeds to step 810, or until all the binary pattern data 
in the rectangular window have been checked according to 
5 steps 802, 804 and 806. For example, assuming that the 
checking process has reached column k and column -k , if 
condition (6) is false, then the detection process stops for 
the current pixel p 0/ o location and the luminance 
transition range is considered as 2*(£-l) + l pixels wide 
10 (step 810) . However, if condition (6) is true but k equals 
W -\ 

to — - — (step 804) , indicating that all the binary data 

inside the rectangular window have been checked, the 
detection process stops for the current pixel p 0 ,o location 
and the luminance transition range is considered as 
15 (2*k + l) = W pixels wide (step 808). 

In the above process, detecting the luminance transition 

range for other than an approximately ±45° edge is conducted 
according to the condition in relation (6) , wherein the 
20 detection starts with k-2 (step 800). Each time the 
binary pattern data in column k and column -k are 
compared with that in column k-l and column -(£-1), 
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w -\ 

respectively. If they are the same, and k < — - — (step 804), 

then k is increased by 1 (step 806) and the same checking 

W-l 

process continues. If they are the same, and k = — - — , then 

the checking terminates for the current pixel p 0t0 location 
5 and the luminance transition range is considered as W 

pixels wide centered with the current pixel p 0 ,o (step 808) . 

If the binary pattern data in column k and column -k 
are not the same as that in column k-\ and column -(£-1), 
10 respectively, then the checking process terminates for the 
current pixel p 0/0 location and the luminance transition 
range is considered as 2*(£-l)+l pixels wide, centered with 
the current pixel (810) . 

15 As such, the example detection system 100 and method 

according to the present invention, described herein, 
determines both the center position and the luminance 
transition range of slant image edge. This allows separate 
or different processing of the detected pixels from other 

20 image areas. The quality of image edges, especially slant 
edges, can be preserved while the other image areas can 
still be effectively enhanced. Such a detection method is 
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useful not only in image detail enhancement, but also in 
image processing techniques wherein image edges must be 
processed separately or differently from the other image 
areas . 

While this invention is susceptible of embodiments in 
many different forms, there are shown in the drawings and 
will herein be described in detail, preferred embodiments of 
the invention with the understanding that the present 
disclosure is to be considered as an exemplification of the 
principles of the invention and is not intended to limit the 
broad aspects of the invention to the embodiments 
illustrated. The aforementioned detection system according 
to the present invention, can be implemented in many ways, 
such as program instructions for execution by a processor, 
as logic circuits, as ASIC, as firmware, etc., as is known 
to those skilled in the art. Therefore, the present 
invention is not limited to the example embodiments 
described herein. 

The present invention has been described in 
considerable detail with reference to certain preferred 
versions thereof; however, other versions are possible. 
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Therefore, the spirit and scope of the appended claims 
should not be limited to the description of the preferred 
versions contained herein. 
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